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ABSTRACT 

This note is concerned with the regularity of solutions of algebraic Riccati equations 
arising from infinite dimensional LQR and LQG control problems. We show that 
distributed parameter systems described by certain parabolic partial differential equations 
often have a special structure that smoothes solutions of the corresponding Riccati 
equation. This analysis is motivated by the need to find specific representations for Riccati 
operators that can be used in the development of computational schemes for problems 
where the input and output operators are not Hilbert-Schmidt. This situation occurs in 
many boundary control problems and in certain distributed control problems associated 
with optimal sensor/actuator placement. 
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1. INTRODUCTION 


In [LCT], Lupi, Chen, and Turner considered a distributed parameter LQR problem for an 
Euler-Bemoulli beam model. Although this problem has been considered by several 
people over the past ten years, the approach in [LCT] is of interest in that they make no 
prior assumptions regarding the form of the controls/actuators in an effort to make 
decisions about where actuators and sensors are best placed. In particular, in [LCT] they 
assumed that the input operator was the identity. Miller and van Schoor [MvS] also 
considered the problem of constructing kernels for integral representations of feedback 
control laws obtained by solving LQR control problems for various beam models. They 
used these kernels to shape and design area averaging polyvinylidene fluoride sensors (a 
type of piezoelectric film). These sensors enable the real-time implementation of full state 
feedback for the infinite dimensional system governed by the Euler-Bemoulli equation 
(also, see [MvS]). As in [LCT], Miller and van Schoor assumed the existence of an 
integral representation for the feedback control law and then proceed to "approximate" 
these kernels by using finite element models. In both papers, fundamental mathematical 
questions concerning the existence of integral representations and the smoothness of the 
corresponding integral kernels are not considered. These issues are important in the 
development and analysis of rigorous numerical approximations. Also, the ability to 
accurately compute these kernels is an essential component in the study of actuator/sensor 
placement. 

During the past ten years considerable effort has been devoted to the study of Riccati 
equations associated with LQR and LQG control of distributed parameter systems in 
Hilbert spaces. In the recent papers by Rosen ([Rl], [R2]) and De Santis, Germani and 
Jetto [DGJ] it was shown that, under suitable assumptions on the system input, output and 
weighting operators, that the Riccati operator is Hilbert-Schmidt. This observation made 
it possible to develop an approximation theory in the space of Hilbert-Schmidt operators 
and, as noted in [DGJ], the smoothness action of Hilbert-Schmidt operators can be 
exploited to relax the hypothesis that approximation schemes converge to the dual 
semigroup. In addition, if the Riccati operator is Hilbert-Schmidt, then one has explicit 
representation theorems that can be used to analyze the convergence of numerical 
approximations. 

The papers noted above represent two basic approaches to the problem. Rosen [Rl] 
considered the problem for control systems where the generator of the semigroup was 
strongly coercive and developed a theory for this restricted class of systems. In [DGJ] the 
approach was to consider general dynamical systems (not necessarily analytic semigroups), 
and then require that certain system operators (input, weighting, etc.) be nuclear. The 
problem we consider in this short note lies between these two approaches, although it is 
more in the spirit of Rosen [Rl]. We extend Rosen's results to control systems governed 
by parabolic equations without requiring that the other system operators be Hilbert- 
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Schmidt. Indeed, the results below apply to a large class of control problems with 
unbounded input operators. In order to focus the discussion we consider only the LQR 
problem. However, the ideas and methods extend to LQG and MinMax control problems. 


2. THE PROBLEM DESCRIPTION 

Consider the control system 

(2.1) i(0 - Ax(t) + Bu(t), x(0) - x 0 
with controlled output 

(2.2) z(t) - Cx(t) 
and cost function 

J(“) - \ J«2(0»2(0> 

^ 0 

If Q = C*C, then J becomes 

(2.3) J(u) - i J{(0*(l),x(O) +{u(t),u(t))}dt, 

^ o 

where the state weighting matrix Q is self-adjoint and non-negative definite. Although it is 
possible to consider more general systems or the case with Q unbounded and B bounded, 
we limit our discussion to systems satisfying the following standing hypothesis: 


(H) The spaces X, Z and U are separable Hilbert spaces and; 

(i) The linear operator A is the generator of a Cp-semigroup S(t) on X and there 
exist M > 0, to > 0 such that |S(f)|| £ 

(ii) The operator C:X -*■ Z is a bounded linear operator from X to Z. 

(iii) The (possibly unbounded) linear operator B maps U intoX and B:U -* 
[Dom(A*)]'. Moreover, there exists a gamma with 0 s y < L such that 
A' y Be L(U,X). 
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(iv) For each xq E X there exists a control u(.) E 1 * 2 ( 0,00 ;U) such that the 
functional J(u) in (2.3) is finite. 


When the optimal control exists, it is given in feedback form 

(2.4) «„(«)-- B'Px^l) --&„(<), 

where P is the non-negative definite solution to the algebraic Riccati equation (ARE) 

(2.5) (Px,Ay) x + (Ax,Py) x - (l B'Px,B*Py) u + (Cx,Cy) z - 0 
for all x, y in Dom(A). 

In [Rl], R2], [DGJ] and [GJP] it is assumed that C and B are bounded linear operators. 
Rosen [Rl] assumes that A is strongly coercive, PBB*P is Hilbert-Schmidt whenever P is 
Hilbert-Schmidt and that Q is Hilbert-Schmidt. On the other hand, De Santis, Germani 
and Jetto [DGJ] make no additional assumptions on A, but require that C be Hilbert- 
Schmidt and B be bounded from U to X. The assumption that C be Hilbert-Schmidt 
implies that the weighting operator Q = C*C is nuclear. Hence, the assumption on Q in 
[DGJ] is stronger than the corresponding condition in [Rl]. The two problems are not 
mutually exclusive and, as one might expect, there is no unified theory. In this paper we 
consider problems with B unbounded and Q not Hilbert-Schmidt. Unbounded B 
operators allow us to treat certain boundary control problems and problems with 
piezoelectric actuators/sensors. Also, the case where Q-B-I x (the identity on X) arises 
naturally in the solution of optimal sensor/actuator location problems (see [BK1], [KM] 
and [LCT]). 

We consider here the case where A generates an analytic semigroup. The following 
theorem may be found in [LT]. 


Theorem 2.1 Assume that hypothesis (H) holds. If A generates an analytic semigroup, 
then there exists a self-adjoint, non-negative definite bounded linear operator P = P* 
that solves the ARE (2.5). Moreover; 

( a) For each e > 0, the operator [A ’] Ut P belongs to L(XJC). 

(b) If A is self-adjoint, normal or has a Riesz basis of eigenvectors, then e can 
be taken to be 0. 

(c) The operator B*P belongs to L(X, U). 
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Observe that if A has a compact resolvent, then P is compact. In general it is not possible 
to conclude that P has additional smoothing properties unless more is known about the 
operators A, B and C. Consider the following example: 

Example 2.2 Let X = Z = U = L2(0,l) and set A = C = I. If B = V3I, then P = I is the 
unique positive-definite solution to the ARE (2.5). Hypothesis (H) holds and A generates 
an analytic semigroup. However, P is not compact. 

In certain specific cases it is possible to obtain additional information about the regularity 
of the Riccati operator P. In the next section we consider a parabolic control problem 
similar to the one treated by Rosen (see [Rl], [R2]) and use classical representation theory 
to show that P is Hilbert-Schmidt. This particular approach not only yields very precise 
information about the smoothness of P, it leads to a rather simple proof. 


3. A PARABOLIC CONTROL PROBLEM 

In order to keep the present paper short we shall limit our discussion to a ID parabolic 
control problem. Although problems in higher dimensions can be treated in a similar 
fashion (subject to the Sobolev imbedding theorems), the analysis is more complex and 
will appear in a future paper. 

We consider the operator A defined on the state space X = L2(0,l) with domain 

(3.1) Dom(A)-H l 0 [0,l]C)H 2 [0,l], 
and for cp EDom(A) 

(3.2) [A<pXS)--^t<P(S). 

<&> 

In order to simplify the proof, we begin with the case where Z = X = L 2 ( 0 ,l), C ~Q~I Ll 

and B:U *[Dom(A')] satisfies (H)-(iii). The extension to general C operators and 

unbounded input operators B satisfying hypothesis (H) is straightforward. We note that 
if B is bounded into X, then (H) is satisfied. 

The controlled heat equation is (see [Rl], [R2]) written as 

(3.3) + »«■ 

ot ofc 
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with boundary conditions 

(3.4) w(f,0)-0, w(t,l)-0, 0 <t 

and cost function 


- +» 1 

(3.5) J(u) - - f{f [|«<*,a| 2 $¥®dt. 

L 0 0 

This problem has the form (2.1)-(2.3) and hypothesis (H) holds. The operator A is self- 
adjoint and generates an analytic semigroup on X. Also, the finite cost condition (H)-(iv) 
holds for any B. 

Note that Q is not Hilbert-Schmidt (it is not even compact). Therefore, the results in [Rl] 
and [DGJ] do not apply to this problem. However, we shall show below that the Riccati 
operator P is Hilbert-Schmidt. Moreover, the special structure of the generator A can be 
exploited to obtain additional information about the functional gains. We shall need the 
following representation theorem which goes back to Fullerton in 1946 (see Theorem 6 on 
page 277 in [FI]). 


Theorem 3.1 Let T be a bounded linear operator mapping Z, 2 [0,1] into C"[0,1]. Then 
there exists a function t ) such that T has the representation 

(3.6) [r<pxi)-j *(t. '«<)<*, 

0 

where the kernel k{%, t) satisfies the following conditions ; 

(i) *(s,oei 2 ([o,i]x[o,i]). 

(ii) For each § e ( o , l ), the mapping \ * k(%, t) belongs to C" [0, 1] for almost 

all t and for asm, 

(3>7) -^-*(1, 0 ei 2 ([o, i] x [o, ip. 

( Hi) For each (p EI 2 [0, 1], 

(3,8) tztJ J ^rK%,tMt)dt. 
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The following result establishes the existence of an integral representation for the Riccati 
operator and provides information about the smoothness of the kernel. 


Theorem 3.2 Assume C-Q- 1 and B:U >[Dom(A‘)]' satisfies (H)-(iii). If P - 

P* is the unique non-negative definite solution to the algebraic Riccati equation (ARE) 
defined by the system (3.1)-(3.5), then P is Hilbert-Schmidt. Moreover, there exists a 
function *(§, t) such that P has the representation 

1 

(3.9) [*PXS)-J K%,t)y(t)dt, 

0 

where the kernel kfct) satisfies the following conditions ; 

(1) *(S,0-*(a)ecH[04]*[o,i]). 

(2) For each q>e^[0,l], ip - P»P S C l [0,l] and 

(3.10) ^n>(l) “ ^ J K%d)<V(t)dt - J -^k(%,t)q>(t)dt. 


Proof. Let A be the extension of A defined by (3.1) - (3.2) to tf 2 [0,l]. It follows from 
Theorem 2.1 that P and AP are bounded linear operators on L2(0,l). Therefore, there 
exist constants cj and C2 such that for all cpEL^O.l], ftp E// 2 [0,1], APfp EL 2 [0,1] and 

(3.ii) I M, s C M, and H, s c ^- 

The space Dom(A ) - H 2 [ 0,1] with graph norm |<p| D<>ii(i) - HL, + is equivalent to 

H 2 [0,1] (see [A]). It follows from the Sobolev imbedding theorem that 
Dom(A) - H 2 [ 0,1] is continuously imbedded in C f [0,l] and hence there exists a constant 
C3 such that for all op EH 2 [0,1] 

(ML + ^'U sc 3MU) ’ c aM 2 + |HL } * 

Let (pEL^OA] and tp - P<p E// 2 [0,1]. Then, 

INI C . + || AP( pL>’ 

and it follows from (3.11) that 
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INIc 35 ^INL + 1^^} 35 c 3( c i + c 2}|| ( pL i - 

Consequently, P is a bounded linear operator from Z, 2 [0,1] into C^O.l]. Applying 
Theorem 3.1, yields the representation (3.9). 

Since P = P the kernel k(^,t) satisfies k(%,t) - k(t,^). It follows from part (ii) of 
Theorem 3.1 that 6C'([0,1] x [0, 1]) and (3.10) is a consequence of part 

(iii) of Theorem 3.1. Finally, (see page 210 in [RSJ) the operator P:L 2 [ 0,1] •* Z. 2 [0, 1] 

is Hilbert-Schmidt since it has the representation (2.9) with £(lj,r)EL 2 ([0,l]x[0,l]). 

I 

Corollary 33 Assume A is defined by (3.1)-(3.2), C = Q-I and B:U *I 2 [0,1] is 

bounded. IfP-P* is the unique non-negative definite solution to the algebraic Riccati 
equation (ARE) defined by the system (3.1)-(3.5), then the gain operator K - -B'P is 
Hilbert-Schmidt. 


Remark 3.4 Observe that if A is defined by (3.1)-(3.2), then the proof given above goes 

through without change for any bounded C:Z. 2 [0,1] *Y and B satisfying (H). In 

particular, there is no need to assume that C (or B) is Hilbert-Schmidt (see [Rl], [DGJ] 
and [GJP]) and B can be unbounded. Also, as noted above, similar results (weaker) are 
valid for 2D and 3D problems. Let Q denote a smooth bounded domain in R n , ns3, with 
boundary T. Although for each 6 > 0 the imbedding H 2 ( Q) *H 3 IM (Q) ►C°(Q) 

is valid, the imbedding H i+m (Q) ► C^Q) holds only for m >— . Hence, one would 

2 

expect less smoothness for n > 1 . These issues will be addressed in a future paper. 


4. NUMERICAL RESULTS AND CONCLUDING REMARKS 


In this section we present some numerical results to demonstrate the role that the operator 
B plays on the smoothness of the operator P. We conducted several experiments for the 
operators B - [-A] p where 0 - -1/2, 0, 1/4, 1/2, 3/4, and 1. Note that if 0 < 1, 
then hypothesis (H) is satisfied. When 0 - 0, B - I Lj and B - [-A] ( ' 1/2) is compact. We 

selected this collection of B operators because as 0 ► 1 the operator 

A~ l B-A- l A* in condition (H)-(iii) becomes "less smooth". Observe that if 0 - 1, 

then (H>-(iii) is not satisfied for any y < 1. 

We use standard linear finite elements to compute k N (%,t) <=<it(|,r), the "N^ 1 order 
approximation" of the kernel k(%,t) . Figure 4.1 and Figure 4.2 show the N = 4, 8, 16 and 


7 



32 finite element approximations of k(%, t) for the cases B - [-A]* V2) and B~I Lj , 

respectively. Observe the fast convergence k N (^,t) * kQz,, 0 and, as implied by 

Theorem 3.2, the kernel £(|, t) is smooth. Figure 4.3, Figure 4.4 and Figure 4.5 contain 
analogous plots for B - [-Af where p- 1/4, 1/2 and 3/4, respectively. It is 

interesting to note that as (3 *■ 1 the kernels k(^,t) become less smooth. Moreover, 

when p-1 Theorem 3.2 breaks down and k N (%,t) appears to be converging to a 

"singular measure" concentrated on the line ^ ™ r . Similar results were observed for 
weakly damped hyperbolic problems in [BK1] and for beam equations in [LCT]. 

As noted in Corollary 3.4, when A is defined by (3.1)-(3.2), C = Q - / Lj and 

B.U * I 2 [0,1] is bounded, then the gain operator K~-B’P is Hilbert-Schmidt. In 

some cases (e.g. U - L 2 [Q'] where £2' C[0,1]) it is possible to obtain explicit integral 

representations of K--B'P. The case where B is unbounded requires additional 
analysis. Finally, the authors wish to thank J.S. Gibson for Example 2.2 and several 
helpful comments. 
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